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WHAT IS CLAIMED IS: 

-3r: An imaging cLppaiaLus — for obtaining depth^ 

of an object to be imaged, comprising: 

an image capturing section^ft5r capturing three or more 
parallactic images of th^^t5bject viewed from three or more 
different viewpoint^which are not arrayed in a line; 

a displac§jfl6nt detector for detecting plural 
displacement with respect to images of a specific region of 
the object, each displacement being detected bdt^ween any two 
of the^ three or more parallactic images; and 

a depth calculator for calculating depth information 
wijzfh respect to the sp ecific region, based on the )6lural 

icement detector. 



ements detected by the 



2 . The imaging apparatu 
the depth calculator has pr 
consideration of the pi 



di; 



claijn^et-rtn claim 1, wherein 
lined ratios for 
.acements to calculate the 



depth information^^nd, for each specific region of the 
object, changes the consideration ratios 



e~nr 



rhe imaging apparatus as claimed in claim 
the depth calculator changes the consider^jkarcSh ratios 
depending on an azimuth of the specific region of the object 
viewed from near a center posi^ferlon of the three or more 
viewpoints . 



4. The imaging apparatus as claimed in claim 3, wherein 
the depth calculator gives a consideration smaller ratio to 
the displacement detected between a particular pair frorrk the 
three or mgtre parallactic images, viewed from a corresponding 
pair frojtf the three or more viewpoints, if the specific 
region/of the object is nearer a line being drawn between t)^e 
£spc>rietThg pair ot * tn^e-^iewpoints , and 

reater consideratiop^ratio 



corr^sporietlng pair of 

^the depth calculator gives 
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to the fiinpl n rrmmt if M il ^rrif Trr^qi^n is nearer a 
which includes a middle point of a line segment dr^/n between 
the corresponding pair of viewpoints and is perfpendicular to 
the line segment between the corresponding pair of viewpoints 



5. The imaging apparatus as claimed in claim 3, wherein, 
if an angle of the azimuth of t/ne specific region of the 
object is less than 3 0 degree when viewed from a middle point 
between a particular pair/from the three or more viewpoints, 
the depth calculator calculates the depth information based 
on the displacement detected between the corresponding 
parallactic images Viewed from said pair of viewpoints. 




6. The imaging apparatus as claimed in claim 1, wherein 
the viewpoints comprise three viewpoints, and the three 
viewpoints define a regular triangle. 



7. Ther imaging apparatus as claimed in claim 1, wherein 
the image aapturing section includes three or more optical 
lenses ha\^Lng a wide visual angle and being located at 
respective three or more viewpoints, the three or more 
parallactic images being captured by the three or more 
optical /lenses. 



8/ The imaging apparatus as claimed in claim 7, wherein 
each off the three or more optical lenses has an optical axis, 
and directions of the optical axes of the three or more 
opticfel lenses are substantially identical. 



9. The imaging apparatus as claimed in claim 7, wherein 
the/ three or more optical lenses comprise fish-eye lenses, 
and the depth calcul ator calculates the depth information^ 
thi ough^-a^whole azimuth o^^l^k^obj ect captured by the f^sh- 
ey^lenses of the image capturing^e^i^ion . 
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^^JJL imaging apparatus as claimed in cl-a-drm—-?-, — ha^isg 

three viewpoints arranged to define a regular tri^rr^ie, 

The imaging apparatus as claimed in claim 1, 
wherein the image capturing section includes : 

an optical lens having a wide visual angle; and 
a driver for moving the ojM:ical lens to the three or 
more viewpoints, wherein ther image capturing section captures 
the three or more parallactic images when the driver moves 
the optical lens to th^/three or more viewpoints 

V 

i 12. The imaging apparatus as claimed in claim 11, 
wherein the optical lens has an optical axis, and all 
directions of tfcye optical axis of the optical lens at the 
three or more viewpoints are substantially identical 

V 

/ 13. The imaging apparatus as claimed in claim 11, 
wherein the /optical lens comprises a fish-eye lens, and the 
depth calculator calculates the depth information through a 
whole azinj/uth of the object captured by the fish-eye lens of 
the image/ capturing section. 



14./ The imaging apparatus as claimed in claim 11, 
wherein /the driver moves the optical lens so as for a 
movement locus of the optical lens to define a circle, and 
wherein the three or more viewpoints are located on the 
circle/ of the movement locus. 



.5. The imaging apparatus as claimed in claim 14, 
wherein the viewpoints comprise threg viewpoints located on 
the /ci^tlfle of th^sacjovement locus ,^]2ffte three viewpoints 
defining a regular triarigte" 
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-1 fi ■ -Jg*rer""tTTraging apparatus as cla imed i n claim ly 
wherein the image capturing section includes: 

two optical lenses positioned at two d>fTerent 
viewpoints of the three or more viewpoi^us, each of the 
optical lenses having a wide visual/angle; and 

a driver for moving either/one of the two optical lenses 
to another one of the three more viewpoints which is not 
on a line drawn between tKe two different viewpoints, wherein 
the image capturing section captures parallactic images of 
the object by the twczr optical lenses and, when the driver 
moves the either oizfe of the two optical lenses, captures the 
other parallactic/ images. 



17. The /imaging apparatus as claimed in claim 16, 
wherein the other viewpoint to which the driver moves the 
either of tyfie two optical lenses is the third viewpoint, and 
the two viewpoints before moving and the third viewpoint form 
a regular/ triangle . 



18./ The imaging apparatus as claimed in claim 16, 
wherein /each of the two optical lenses has an optical axis, 
and all / directions of the optical axes of the two optical 
lenses Jat the three or more viewpoints are substantially 
identiqal . 

lSj. The imaging apparatus as claimed in claim 16, 
whereiii the two optical lenses comprise fish-eye lenses, and 
the dep^th calculator calculates the depth information \through 
a whole azimuth of the object captured by the fish-eye \enses 
of the Image capturing section. 

An i mage p rocessing apparatus for obtaining depth 
of an object^fe<^be imaged, comprising: 




input unit for input ti 




hree or more parallactic 
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dmacj e n nf tin 1 j ,tJ M " i rvr^H fr^m thr^^ ~r m^r Q ^ r i*n 
which are not arrayed in a line; 

a displacement detector for detecting^lural 
displacements of any pair from the three or more parallactic 
images with respect to a specific region of the object; and 

a depth calculator for calculating depth information of 
the specific region of the object, wherein ratios for 
consideration of the plural/aisplacements are changed with 
respect to the specific region. 



21. The image p/ocessing apparatus according to claim 

20, further comprising: 

an image transformer for transforming the images of the 
object inputted l/y the input unit, wherein the image 
transformer subjects the images to a coordinates 
transf ormation/ based on the depth information calculated by 
the depth calculator with respect to the specific region of 
the object 

22 . /The image processing apparatus as claimed in claim 

21, where/In, if the image inputted by the input unit is a 
whole azimuth image captured by a fish-eye lens, the image 
transformer transforms the whole azimuth image into a 
perspective projection image by the coordinates 
transformation . 



£3 . The image processing apparatus as claimeB in claim 
21, wHerein the image transformer generates an ortpogonal 
projection image of the object by the coordinatesy 
transformation . 



24 . 




o obtain depth 
omprising steps of: 



information of an object to 

inputting three or more parallactic images of the object 
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,vie^&Gir— rrGrn three or more different viewpoints whict^a^e not 
arrayed in a line; 

detecting plural displacements with respect to a 
specific region of the object, each displacement being 
detected between any two of the thr^e or more parallactic 
images ; and 

calculating depth information of the specific region of 
the object, wherein ratios for consideration of the plural 
displacements are changed with respect to the specific region 



25. A recording medium storing a computer program for 
obtaining depth information of an object to be imaged, 
comprising : 

an input module/ for inputting three or more parallactic 
images of the objecyc viewed from three or more different 
viewpoints which are not arrayed in a line; 

a displacement detecting module for detecting plural 
displacements witm respect to a specific region of the object 
each displacement being detected between any two of the three 
or more parallactic images; and 

a depth ca/Lculating module for calculating depth 
information of /the specific region of the object, wherein 
ratios for consideration of the plural displacements are 
changed with respect to the specific region. 



^ ^ 26. A System for determining distance from an object 
for generati/ng an image of said object, comprising: 

at least one lens for capturing three or more images of 
the object/ said images being captured from corresponding 
positions /of said at least one lens which are not \arrayed in 
a line; 

a displacement detector for detecting a plurality of 
parai;ykc£ircr'~3Tsi^^ each displacement being detected 

with/respect to two of sai^^fetiree or more imac&s; and 
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"calculator for calculating a distance t r om Sc 
object based upon the plurality of parallactic disgjLatfements 
detected by the displacement detector. 



27. The system as claimed in claim 26, wherein said 
displacement detector detects said plurality of parallactic 
displacements with respect to images of corresponding regions 
of the object; said two of sai/ three or more images 
corresponding to each displacement are selected so as to 
provide a largest displacement with respect to a 
corresponding region thereof; and said distance from said 
object is calculated by a distribution of distances from said 
object, each distance? of said distribution corresponding to a 
region of said regions of the object. 

28. The system as claimed in claim 26, wherein said 
displacement deycector detects said plurality of parallactic 
displacements /with respect to images of a corresponding 
region of they object; said depth calculator includes 
predetermined ratios of how much each one of said plurality 
of parallactic displacements is to be considered in 
calculating a distance from said corresponding region of the 
object; and said distance is calculated based upon said 
ratios of said parallactic displacements. 



The system as claimed in claim 26, wherein said 
displacement detector detects said plurality of parallactic 
displacements with respect to images of a corresponding 
region of the object; said depth calculator calculates 
respective distances from said corresponding region based on 
saifl. plurality of parallactic displacements; and a distance 
fr^m said corresponding region of I the object is calculated by 
a/ w^rqnteTTHi^an or said respective distances based upon said 



iral lactic displac 



its 
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* 2&~. T h e syt = rtr em as ci~glmed in claim 2G - — wke^ci n ..agj-d_-^= 

displacement detector detects said plurality ofpafallact ic 
displacements with respect to images of a cerfresponding 
region of the object; and said depth CprfTculator calculates a 
distance from said corresponding rjagion of the object based 
upon a parallactic displacement/having a highest detection 
accuracy of said plurality of parallactic displacements. 

31. The system pes claimed in claim 26, wherein said 
displacement detecto/ detects said plurality of parallactic 
displacements with /respect to images of a corresponding 
region of the object; said depth calculator calculates an 
initial distance from said corresponding region of the object 
based upon a parallactic displacement having a highest 
detection accuracy of said plurality of parallactic 
displacements and determines ratios of how much each one of 
said plurality of parallactic displacements is to be 
considered in calculating a final distance from said 
corresponding region of the object, said ratios being 
determj/ned based upon an azimuth angle of said corresponding 
region/ and said initial distance from said corresponding 
regiom, wherein said final distance is calculated based upon 
said /ratios of said parallactic displacements. 



32. The system as claimed in claim 26, wherein said 
syst/em includes an imaging apparatus. 

33. The system as claimed in claim 26, wherein said 
syspem includes an image processing apparatus. 



S4. ^Tt^e system as claimed/in claim 26, wherein said 
system includes assComputer . 
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